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ABSTRACT 

Optimal  fire-support  strategies  are  studied  through 
a  deterministic  differential  game  using  Lanchester-type 
equations  of  warfare.   In  addition  to  the  MAX-MIN  prin- 
ciple, the  theory  of  singular  extremals  is  required  to 
solve  this  prescribed  duration  combat  problem.   The  com- 
bat is  between  two  heterogeneous  forces,  each  composed 
of  infantry  and  a  supporting  weapon  system  (artillery). 
In  contrast  to  previous  work  reported  in  the  literature, 
the  attrition  structure  of  the  problem  at  hand  leads  to 
the  optimal  fire-support  strategy  of  the  attacker  requir- 
ing him  to  sometimes  split  bis  artillery  fire  between 
enemy  infantry  and  artillery  (counterbattery  fire).   Nu- 
merical examples  are  given.   The  military  significance 
(based  on  the  marginal  value  interpretation  of  the  dual 
variables)  of  various  optimality  conditions  is  discussed. 
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TABLE  I 


Notation 


x  (t),  x  (t)  ,  y,(t),  y_(t)  --  State  variables,  number  of 

survivors  of  X  ,  X  ,  Y  ,  Y   at  time  t. 
T    —  Specified  duration  of  the  battle. 
p  (t)  ,  p  (t)  ,  q  (t)  ,  q2(t)  --  Adjoint  (dual)  variables, 

the  value  of  X  ,  X  ,  Y  ,  Y  ,  respectively  at  time  t. 
a    —  Attrition  coefficient,  average  rate  at  which  one 

Y   attrits  X  . 
a    --  Average  rate  at  which  one  Y   attrits  X  . 
b    —  Average  rate  at  which  one  X   attrits  Y  . 
b_   --  Average  rate  at  which  one  X   attrits  Y  . 
c    --  Rate  at  which  Y   attrits  X  . 
<f>    --  Decision  variable,  fraction  of  Y   fire  directed  at 

X.,  0  £  <f>  <_  1. 

lp    --  Fraction  of  X   fire  directed  at  Y  ,  0  <_  \p    <_   1 . 

(J) ,  iJj  --  Optimal  values  of  <f>  and  \\) . 

J    —  Criterion  functional,  the  ratio  of  the  final  values 
of  X   and  Y  ,       X  (T) 

J   = 


Y1(T) 


T    --  Backwards  time,  X  =  T  -  t. 

T,   —  Backward  time  at  which  strategy  change  occurs  for  Y, 

T.   —  Backward  time  at  which  strategy  change  occurs  for  X, 

T  *  --  Backward  time  at  which  X„  begins  to  split  his  fire, 

x  f,  x  f,  y  f ,  y  f  --  Final  values  of  the  state  variables 

at  t  =  T. 

ylf*  a2b2   -b  x  ft  * 

—  =  ; —  e   2  2  i)       ,     The  value  of  this  ratio  which  in- 

y  f  11 
2  sures  a  singular  solution  in  ty* . 


I.   INTRODUCTION 


The  determination  of  optimal  fire  distribution  stra- 
tegies for  supporting  weapon  systems  such  as  artillery, 
air  resources,  or  naval  gunfire  is  a  major  problem  of 
military  operations  research.   This  problem  in  one  form 
or  another  is  probably  one  of  the  most  extensively  stud- 
ied problems  in  both  the  open  literature  and  in  classi- 
fied sources.   The  problem  is  of  interest  to  the  military 
tactician  in  hopes  of  gaining  a  clearer  understanding  of 
the  circumstances  under  which  enemy  infantry  should  be 
engaged  by  a  supporting  weapon  system  and  those  under 
which  "counter-battery"  fire  is  to  be  preferred.   It 
should  be  stressed  that  the  objective  in  researching  this 
problem  is  not  to  determine  what  strategies  are  employed 
by  combatants,  but  rather  to  attempt  to  understand  what 
strategies  should  be  employed  for  optimal  effectiveness. 

It  is  appropriate  to  briefly  sketch  past  efforts  in 
the  study  of  "allocation"  problems  and  how  this  work  is 
related  to  those  efforts.   The  problem  of  the  appropriate 
mixture  of  tactical  and  strategic  forces  (another  aspect 
of  the  optimal  fire  support  strategy  problem)  was  exten- 
sively debated  by  experts  during  World  War  II.   Some 
analysis  details  may  be  found  in  the  classical  book  by 
Morse  and  Kimball  [7] .   The  problem  was  studied  at  Rand 


in  the  late  1940's  and  early  1950's  in  the  form  of  a  tac- 
tical air-war  [2].   It  would  probably  not  be  unrealistic 
to  claim  that  this  problem  stimulated  early  research  on 
both  dynamic  programming  [1]  and  on  differential  games 
[2],  [3],   Today  the  problem  of  optimal  air-war  strate- 
gies is  being  extensively  investigated  by  a  number  of  or- 
ganizations (see,  for  example,  [6],  [8],  [14]). 

Another  related  problem  was  considered  by  Weiss  [15], 
who  studied  the  optimal  selection  of  targets  for  engage- 
ments by  a  supporting  weapon  system.   Later  Taylor  [11] 
justified  the  optimality  of  strategies  determined  by  Weiss 
Recently,  Kawara  [5]  studied  optimal  strategies  for  sup- 
porting weapon  systems  in  an  attack  scenario  which  is  a 
variation  of  the  model  that  was  considered  by  Weiss  [15] . 
Other  recent  work  has  considered  various  conceptual  and 
computational  aspects  of  the  time-sequential  combat  games 
[8]  ,  [9]  ,  [10]  . 

Since  the  work  here  may  be  considered  to  be  an  elabo- 
ration upon  and  extension  of  Kawara's  fire  support  differ- 
ential game  [5] ,  it  seems  appropriate  to  review  the  major 
results  of  that  work  and  to  relate  this  work  to  it.   In 
[5]  Kawara  considered  combat  between  two  heterogeneous 
forces,  each  composed  of  infantry  (the  primary  weapon  sys- 
tem) and  artillery  (the  supporting  weapon  system).   The 
problem  required  the  determination  of  the  optimal  strategy 
for  each  side  in  distributing  the  fire  of  its  supporting 


weapon  system  over  enemy  target  types.   This  according  to 
the  criterion  of  the  force  ratio  of  infantry  at  the  end 
of  the  prescribed  duration  attack  scenario.   Kawara  con- 
cludes that  each  side's  optimal  strategy  for  the  distri- 
bution of  its  supporting  weapon  system's  fire  is  to  always 
concentrate  all  fire  on  the  enemy's  supporting  weapon  sys- 
tem (counter-battery  fire)  during  the  early  stages  of 
battle  (if  the  total  prescribed  length  of  battle  is  suffi- 
cient) and  at  an  appropriate  time  switch  to  concentration 
of  all  fires  on  the  enemy's  infantry. 

Kawara  concludes  that  this  switching  time  is  indepen- 
dent of  current  strength  of  either  side,  and  dependent 
only  on  the  effectiveness  of  both  sides'  supporting  units. 
Moreover,  an  optimal  strategy  hc.s  the  property  of  always 
requiring  concentration  of  supporting  fires  on  enemy  in- 
fantry during  the  final  stages  of  battle.   Essentially, 
Kawara  concludes  that  optimal  strategies  are  independent 
of  force  levels.   This  conclusion  is  only  true,  however, 
if  the  appropriate  side's  supporting  weapon  system  is  not 
reduced  to  a  zero  force  level  before  a  critical  time  as 
illustrated  by  Isaacs  [4] .   Given  that  this  is  the  case, 
Taylor  shows  in  [13]  that  the  optimal  strategies  are  a 
function  of  the  criterion  functional  for  a  given  set  of 
combat  attrition  equations,  and  that  Kawara  considered 
the  only  type  of  criterion  functional  (objective  function) 
which  yields  optimal  strategies  independent  of  force 
levels  . 


The  purpose  of  this  work  is  to  illustrate  the  depen- 
dence of  the  structure  of  the  optimal  strategies,  for  the 
case  in  which  neither  sides'  supporting  units  are  all 
lost,  upon  model  form.   What  is  considered  here  is  a 
slight  variation  in  Kawara's  problem  for  which  the  struc- 
ture of  the  optimal  strategy  of  one  of  the  combatants  is 
significantly  different  from  that  in  the  original  problem 
[5] :   the  optimal  strategy  of  one  combatant  depends 
directly  upon  the  enemy's  force  levels  and  is  no  longer 
to  always  concentrate  all  fire  on  either  the  enemy's 
primary  or  supporting  weapons  system.   The  optimal  stra- 
tegy of  one  side  to  sometimes  split  its  fire  is  very 
similar  to  that  which  occurs  in  a  one-sided  (optimal 
control)  problem  considered  by  Taylor  [12]  for  the  opti- 
mal distribution  of  fire  by  a  homogeneous  force  in  combat 
against  homogeneous  forces.    [12]  was,  in  fact,  partial 
motivation  for  the  examination  here  of  another  attrition 
structure  in  Kawara's  problem. 


II.   THE  MODEL 

A.    THE  DIFFERENTIAL  GAME  FORMULATION 

Consider  the  following  model,  cast  in  the  form  of  a 
differential  game,  of  a  prescribed  duration  battle  de- 
scribing combat  between  two  opposing  forces  each  with 
primary  and  supporting  elements. 


1-* 


FIGURE  1 


Maximize  Minimize  J 


X  (T)/Y  (T),  with  T  specified 

(1) 


sub j  ec t    to : 


dt 
dX. 

dt" 

til 

dt 


■a1X1Y1    -    4a2XlY2 


(1-cMcY. 


■*blYlX2 


(2) 


(3) 


(4) 


dY2 

=  -(l-i|»)b_X,Y,  (5) 


dt  '   2" 

with  initial  conditions 


X1(t  =  0)  =  X^  Y1(t  =  0)  =  Y    ' 

X2(t=0)  =  X2°       Y2(t=0)  =  Y2' 


and 


X1'X2'Y1'Y2  -  °  '    °  -   ♦'  *  1  X 


where  all  symbols  are  defined  in  Table  I. 

This  model  represents  a  modification  of  that  presented 
in  Ref.   [5]  inasmuch  as  the  differential  equations  describ- 
ing the  combat  dynamics  have  been  altered  to  allow  Y's  pri- 
mary force,  Y  ,  to  attrite  X's  primary  force,  X  .   Also, 
the  Lanchester  square  law  attrition  of  X's  supporting 
force,  X  ,  on  Y's  supporting  force,  Y   has  been  modified 
to  linear  law  attrition. 

A  scenario  that  leads  to  the  above  mathematical  formu- 
lation is  given  below  in  order  that  insights  gained  from 
the  mathematical  solution  to  this  problem  can  take  on 
other  than  abstract  significance. 

B.    COMBAT  SCENARIO 

A  battlefield  scenario  to  which  the  above  model  might 
be  applied  involves  a  conflict  between  two  forces,  X  and 
Y,  each  with  two  types  of  elements;  infantry  units,  X 
and  Y  ,  and  supporting  artillery  units,  X   and  Y  .   Con- 
sider the  situation  in  which  the  Y  infantry  forces  are 


10 


tasked  with  defending  a  fortified  position  and  are  sup- 
ported in  this  effort  by  Y's  supporting  artillery,  which 
hc.ve  the  capability  of  providing  a  mixture  of  offensive 
fire  on  attacking  units  and  counter  battery  fire.   The 
mission  of  X's  infantry,  X  ,  on  the  other  hand,  is  to 
attack  that  defended  position,  supported  by  X's  artillery, 
X  ,  which  can  fire  a  mixture  of  support  for  X   in  the 
attack,  or  provide  counter  battery  fire  on  Y  .   Since  the 
X  forces  are  in  the  attack,  moving  toward  Y  ,  they  are 
incapable  of  causing  any  attrition  on  either  of  Y's  ele- 
ments.  Y  ,  however,  although  not  within  its  own  weapons 
range  of  X   can  inflict  casualties  upon  the  attacking  in- 
fantry units,  X  .   In  this  instance  the  combat  duration 
T  corresponds  to  the  time  required  for  X's  infantry  to 
close  to  its  final  assault  position  where  it  could  begin 
inflicting  casualties  on  Y  .   In  this  scenario  X  and  Y 
are  faced  with  allocating  supporting  artillery  resources, 
over  the  duration  of  the  battle,  so  that  the  optimal 
value  of  the  ratio  of  remaining  X  infantry  to  remaining 
Y  infantry  at  time  T  is  reached. 

The  scenario  presented  is  the  same  basically  as  is 
presented  by  Kawara  [5]  with  the  addition  of  the  ability 
of  Y's  infantry  to  attrite  X's  infantry.   Taylor  [13] 
shows  that  an  optimal  strategy  in  which  a  side  divides 
the  fire  of  its  supporting  weapons  system  between  the 
enemy's  primary  (infantry)  and  supporting  systems  can 
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only  occur  when  the  enemy's  infantry  has  some  effective- 
ness against  his  infantry.   Is  is  this  division  of  fires, 
or  singular  control  in  the  control  theory  sense,  which 
most  dramatically  illustrates  the  force  level  dependence 
of  optimal  strategies  in  this  problem. 
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III.   DEVELOPMENT  OF  NECESSARY  CONDITIONS  OF  OPTIMALITY 

The  development  of  the  solution  to  the  differential 
game  presented  in  Chapter  Two  is  similar  to  that,  for  an 
optimal  control  problem.  However,  its  complete  solution 
requires  more  than  the  well  known  MAX-MIN  principle  [4] : 
the  theory  of  singular  extremals  must  be  utilized  in  its 
solution.  A  brief  discussion  of  that  theory  is  given  in 
Ref .  [12]  . 

Before  applying  the  above  theory  to  the  problem  at 
hand  it  should  be  pointed  out  that  the  combat  dynamics, 
i.e.  Equations  (1)  through  (5),  and  the  fact  that  the 
combat  duration  T  is  finite,  yield  that  X  ,  Y  ,  Y   will 
always  be  greater  than  zero.   It  is  possible  that  X   could 
be  forced  to  zero;  however,  since  X   controls  the  decision 
variable  ip,  and  the  case  of  interest  is  that  in  which  no 
supporting  units  are  forced  to  a  zero  level,  X   will  be 
assumed  positive. 

The  solution  procedure  begins  by  forming  the  Hamil- 
tonian 

H(X1,X2,Y1,Y2,p1,p2,qi,q2,lJJ,(t),t)={(-a1X1Y1-(()a2X1Y2)p1(t) 
-  (!-<{>)  cY2p2  (t)-ipb1Y1X2q1  (t)  -  (l-l|>)b2X2Y2q2  (t)  } 


where  p. (t)  and  q. (t)  are  dual  variables  associated  with 

X.  and  Y.,  respectively. 
1        x 
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By  the  MAX-MIN  principle 


MAX  MIN  H(X  ,X  ,Y1#Y  ,p  ,p  ,q  ,q  ,l(>,$,t)  =  MAX  MIN  J 


However,  because  of  separability  properties  of  the  Hamil- 
tonian,  this  is  equivalent  to 


min    {~(t>a2X1Y2p1    +    <J)cY2p2} 
max    (-♦b1T1X    q      +    ^    X^^ 


or 


min    {-<t>Y2  (a2X1p1~cp2)  } 
max     {-*X     <b    Y    q    -b    Y    q     >} 


Defining  S , (t)  and  S , (t)  as  the  switching  functions 


for  X  and  Y,  respectively,  where 


Vfc)  =  blYiqi  -  b2Y2^2 
S^t)  =  a2XlPl  -  cp2 


(7) 
(8) 


it  is  clear  that  the  extremal  controls  are  given  by 


and 


l|»*(t) 


<j>*(t)  = 


1   if  S . (t)  <  0 


0   if  S  (t)  >  0 


(9) 


undetermined  if  S. (t)  =  0 


1   if  S,(t)  >  0 
<P 

0   if  SA (t)  <  0 


(10) 


undetermined  if  S,(t)  =  0 
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The  time  history  of  using  these  controls  is  given  by 
the  state  and  adjoint  equations  below  with  boundary  con- 
ditions on  dual  variables  as  derived  from  the  MAX-MIN 
principle . 

State  Equations 

dX 

=  -a.X.Y.-^a.X.Y,  ;   X.(t=0)  =  X  °  (11) 


dt       11  1  Y  2  1  2  '    l1    '      1 

dX 

_—  =  -(l-<j>)cY2         ;   X2(t=0)  =  X2°  (12) 

dY 

dt"  =  "";blYlX2  '•   Vt  =  0>  =  Yl°  U3) 

dY2 

dT-=  -(l-«^)b2X2Y2      ;   Y2(t  =  0)  =  Y2°  (14) 

Adjoint  Equations 

dir  -"f^  =  aiYiPi+*a2Y2p2        »  Pi(t=T)=Y7TTT(15) 


dP2        -3H 


=    l^Y.q    +(l-<J0boY    a     :     p     (t  =  T)=    0  (16) 


dt  3x  n*l^lMi    y'"2i2M2'     ^2 

dq  X    <T) 

IT  =  Wi   =  aixipi+*bix2«i  ;    qi(t=T)=-Y7(TT  (17) 

dq 

d"r  =  W2  =*a2XlPl+(l-cD)cP2+(l^)b2X2q2;  q2(t=T)=0   (18) 


The  necessary  conditions  for  extremal  controls  given 
in  (9)  and  (10)  allow  the  determination  of  optimal  con- 
trols at  battle  termination  T.   This  is  accomplished  by 
noting  that 


S   (t=T)  =  b1Y1(T)q1(T)   -b2Y2(T)q2 (T) 
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and 


S  (t=T)  =  a2X1(T)pi(T)-cp2(T) 


Applying  the  boundary  conditions  to  Equations  (15)  through 

(18) ,  and  noting  that  force  levels  are  all  positive  for 

t<T,  yields  S,(t  =  T)<0  and  S  (t  =  T)>0  implying  that  ip*(T)=l 

and  9*  (T)  =1. 

This  information  allows  the  determination  of  extremal 

controls  when  either  of  the  switching  functions,  S. (t)  or 

S,  (t)  are  identically  zero.   It  is  at  this  point  in  the 
9 

development  of  the  solution  that  the  theory  of  singular 
solutions  must  be  called  upon. 

In  the  discussion  to  follow  a  singular  subarc  will 
denote  that  part  of  an  optimal  trajectory  on  which  the 
MAX-MIN  principle  cannot  be  used  to  determine  the  control, 
because  the  coefficient  of  the  control  variable  in  the 
Hamiltonian  is  zero.   The  term  "singular  solution"  will  be 
used  to  denote  any  optimal  trajectory  which  contains  one 
or  more  singular  subarcs. 

In  partial  elaboration  relative  to  the  problem  at 

hand,  since  the  Hamiltonian  H  is  a  linear  function  of  both 

7i  H      7i  H 
control  variables,  \b    and  <b ,  if  tt-t  or  -s-r  (or  equivalently 

a  (p  oy 

S.(t),  S  ,  ( t )  )  vanish  for  a  finite  interval  of  time,  then 
as  in  the  case  in  (9)  and  (10)  above,  all  feasible  values 
of  the  respective  control  optimize  the  Hamiltonian.  When 
this  occurs  the  singular  control  is  determined  by  requir- 
ing that  the  appropriate  switching  function,  and  all  of 
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its  time  derivatives,  be  zero  for  that  finite  time 
period . 

Investigating  the  behavior  of  Y's  decision  variable, 
where 


a2XlPl  "  CP2  =  ° 


and 


dS.  (t) 

4> 
dt 


-C  {^b1Yiqi+(l-^)b2Y2q2} 


The  existence  of  a  singular  subarc  in  <p    requires  that 


S, (t)=0  for  a  finite  interval  of  time,  implying  that 


dS 


dt 
But, 


*-  0. 


0  <  \p    <    1 


VY2  >  ° 


g  j 

and  q.  =  -r—  ,  where  J  is  the  criterion  functional.   It 
X    d Y .  ,  _. 

x  dS 


can  be  shown  that  q  .  <0  yt  £[0  ,  T]  ;  therefore,  -r— 


*  t 


xs  repre- 


sented by  a  convex  combination  of  negative  quantities  and 


cannot  be  zero.   No  singular  solutions  exist  in  <}> . 

dS. 


Noting  additionally  that 


<J> 


dt 


can  be  rewritten  such 


that 


dS 

dt   =  -^V^  +  b2Y2^2} 


and  the  product  i|>S  (t )  <  OVt  CIO  ,  T]  implying  that 
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-—2-  >  0  VtCtO,T],  but  S,  (T)  >  0  so  there  is  at  most  one 

at  <p 

switch  in  Y's  decision  variable  from  <f>*  =  0  to  <f>*  =  l  which 
would  occur  when  S,(t)  =  0. 

This  information  allows  for  the  investigation  into 
singular  behavior  of  X's  strategic  variable,  \|> ,  under  the 
two  possible  values  of  <j>*. 

Consider  first  what  general  conditions  are  necessary 
in  order  for  a  singular  solution  to  exist  in  4>  by  setting 
successive  time  derivatives  of  S  (t)  equal  to  zero  until 
\\)    appears  explicitly  in  one  of  those  derivatives.   From 


Vt}  =  blYiqi  -  b2Y2^2  "  ° 


and 


dS     (t) 

dT"    =    aiblXlYlPrb2CY2P2-<},b2Y2(a2XlPl-CP2) 


=  0 


two  conditions  necessary  for  the  existence  of  a  singular 
subarc  are: 


Viqi  =  b2Y2*2 


a1b1X1Y1p1  =  b2Y2{4»a2XlPl  +  (l-<|))cp2} 
*      ds.(t) 


Additionally, 


1 


-)  contains  ^  explicitly,  so 


dt    dt 
utilizing  the  above  results  the  singular  control  for  X  is 


**<t)   =(7— T-)   (1- 


(l-(J))cY2q2 


'Vb2 


X2  [*a2XlPl+  (1-<J>)CP2] 


This  expression,  however,  gives  the  value  of  the 
singular  control  for  X  as  a  function  of  Y's  strategic 
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variable,  <J>*.   Therefore,  there  are  two  singular  control 
values  to  be  considered  corresponding  to  the  two  possible 
values  of  (j>*. 

1.   Case  I ;    (<j)*  =  l),  for  this  case  the  conditions 
necessary  for  the  control  to  exist  are 


biqiYl  -  b2q2Y2 
aiVl  =  a2b2Y2 


(19) 


and  the  singular  control  is 


**(t) 


Vb2 


(20) 


2.   Case  II ;    (4>*  =  0)  ,  for  this  case  the  conditions 
for  the  existence  of  the  singular  control  are 


b  Y  Q  =  b  Y  q 

1  141      2  242 

abXYp  =bcYq 
1    1    1    lpl  2       242 


(21) 


and  the  singular  control  is 


b2  Y2q2 


b  +b 
1   2 


2^2 


(22) 


A  further  check  can  be  made  on  these  singular  controls 
to  insure  a  maximum  return  from  the  criterion  functional, 
J,  in  the  form  of  a  further  necessary  condition,  the 
generalized  Legendre-Clebsh  condition, 


(_Dk  JL  {^ (M)  }  <  o 
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which  necessarily  must  be  met   for  a  singular  subarc  to 
yield  a  maximum  return.   In  the  problem  at  hand  it  suf- 
fices to  check  this  condition  for  K=l,  and,  it  can  be 
shown  that  the  condition  is  met  for  both  singular  controls 

The  external  controls  as  further  defined  by  the  above 
are  given  as : 


4>*(t)  = 


1   if   S,(t)>0 
0   if   S, (t) <0 


(23) 


1   if   S  (t)<0 
0   if   S  (t)>0 


if>*(t)  = 


if  S ,  (t)=0  for  a 
b,  +b„      4> 


1   2 


finite  period  of  time 

and  <J>*  =  1  (24) 


b1  +  b2 


Y  q 

(1-   2  2)  if  S  (t)=0  for  a 
X2P2  finitfe  period  of 
time  and  <}>*  =  0 
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IV.   SYNTHESIS  OF  EXTREMAL  CONTROLS 

A.   METHOD  OF  SYNTHESIS 

By  the  synthesis  of  extremal  controls  is  meant  the 
explicit  determination  of  the  time  history  of  the  extremal 
controls  from  initial  to  terminal  state.   This  is  accom- 
plished by  combining  the  extremal  controls  with  integra- 
tion of  the  state  and  adjoint  systems  of  equations.   The 
specific  procedure  used  in  the  solution  to  the  problem  at 
hand  is  to  begin  at  battle  termination,  T,  where  extremal 
controls  are  known,  assuming  final  values  for  state  vari- 
ables.  This  in  turn  yields  the  boundary  conditions  on 
the  set  of  adjoint  equations  in  terms  of  those  final 
values.   The  procedure  is  then  to  solve  the  system  of  dif- 
ferential equations  represented  by  the  state  and  adjoint 

dS  ,      dS, 

equations  combined  with  — — —  and  — — —  ,  the  differential 

dt       dt 

equations  describing  the  behavior  of  the  switching  func- 
tions over  time.   The  solution  of  this  system  of  equations 
and  in  particular  the  values  of  S,  (t)  and  S,  (t)  yield  the 
extremal  controls  over  time  through  Equations  (23)  and  (24) 

In  order  to  facilitate  this  procedure  it  is  convenient 
to  make  a  change  of  variable  to  transform  the  set  of 
boundary  conditions  at  t=T  into  initial  conditions  for 
the  described  system  of  differential  equations.   This  is 
accomplished  by  converting  to  "backwards"  time,  T=T-t, 
and  noting  that  dT  =  -dt. 
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The  procedure  is  then  to  integrate  the  above  set  of 
differential  equations  in  "backwards"  time  from  x=0  until 
the  first  change  in  tactics  occurs  for  either  X  or  Y.  The 
time  at  which  that  switch  occurs  is  then  regarded  as  an 
artificial  terminal  surface  from  which  initial  conditions 
can  again  be  computed  for  the  new  system  of  differential 
equations  as  altered  by  the  new  control.   This  procedure 
is  repeated  at  each  succeeding  tactic  change  until  T=T. 
By  beginning  at  T=0  with  all  possible  elements  of  the  set 
of  terminal  values  of  the  state  variables,  a  field  of  ex- 
tremal trajectories,  resulting  from  extremal  controls, 
could  be  mapped  out  such  that  for  any  initial  state  in 
forward  time  t  at  least  one  candidate  optimal  trajectory 
could  be  found  that  would  lead  to  the  set  of  possible 
final  values  and  thus  max-min  of  the  criterion  functional 
If  more  than  one  trajectory  satisfying  the  derived  neces- 
sary conditions  arrive  at  t=T  at  different  values  of  the 
criterion  functional  the  higher  value  would  be  taken  and 
the  trajectories  leading  to  other  terminal  states  would 
be  deleted. 

Since  the  control  displaying  the  most  interesting 
behavior  is  iJj*,  X's  decision  variable,  and  since  <(>*,  Y's 
decision  variable,  takes  on  only  two  values,  0  or  1,  it 
is  convenient  to  break  the  synthesis  of  extremal  controls 
into  two  regions  as  defined  below. 
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1 .  Region  I ; 

4»*  =  1,  T£[T,,0]  -  or  from  t  =  T  to  the  artificial 
terminal  surface  described  by  switch  in  Y's  control, 

2 .  Region  II : 

4*  =  0,  T£-[T,T,  ]  -  or  from  t  =  t,  to  t  =  0. 
The  procedure  is  then  to  develop  the  time  history  of 
ty*    over  each  region. 


B.    SYNTHESIS  OF  EXTREMAL  CONTROLS  -  REGION  I 

The  investigation  into  the  behavior  of  extremal  con- 
trols proceeds  at  this  point  over  Region  I,  where  4>*  =  1, 
beginning  at  T=0  where  the  optimal  controls  at  battle 
termination  were  previously  shown  to  be  ^*  =  1»  <J>*  =  1. 
Looking  in  "backwards"  time  from  x=0,  there  are  two  con- 
tingencies to  consider.   A  strategy  change  can  occur  for 
X,  in  which  case  a  new  artificial  terminal  surface  will 
be  considered,  or  the  strategy  change  can  occur  for  Y  in 
which  case  the  solution  enters  Region  II. 

The  system  of  differential  equations  transformed  to 
"backwards"  time  which  describe  the  battle  trajectory 
under  controls  ij>*  =  l,  <J)*  =  1  and  their  initial  conditions  at 
T=0  are  given  below. 

State  Equations 

dX. 


VT    =    Xl(aiYl  +  a2Y2);        VT  =  0)     =    Xlf 


dX. 

dr~ 


=    0 


;        X2(T=0)     =     X2 


(25) 
(26) 
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dYl 

^r  =  biYix2 


|  Y1(T=0)  =  Yx 


(27) 


dY. 
dT 


=  0 


;  Y2  (T  =  0)  =  Y2 


(28) 


Adjoint.  Equations 
dp, 


;  Pl(T  =  0)  =  - 


(29) 


dp2 

^r  =  -biYi^i 


;  p2(t=o)  =  o 


(30) 


dq 

—  =  -a1X1P1-b1X2q1 


dq, 

dT"  =  "a2xipi 


'•     <51(T  =  0)=     -     —— - 


(Y1     > 


;    q2(T=0)     =    0 


(31) 


(32) 


Switching    Functions 
dS<fr 

d^r  =  VYiqi 


ax 

;     S.(T  =  0)=  t:  (33) 

4>  v    f 


d£>  blXl 

5^=    "XlPl(aiblYl-a2b2Y2);     S^(T  =  0)=-— f- 


(34) 


The  following  solutions  to  the  above  system  of  equa- 
tions were  developed. 
State  Variables 


X1(T)  =  Xxf  EXP[a2Y2fT LJ_(1_ebix2  T) 


X2(T)  =  X2 

Yl(T)  =  Y/  eblX2fT 

Y2(T)  =  Y2f 


blX2 


]       (35) 

(36) 
(37) 
(38) 
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Adjoint    Variables 

f  aiYl                blX2   T 

P,  (T)    =  -~  EXP    [-a  Y     T  +  -^-+j   (1-e   l   2      )] 

Yl  blX2 


(39) 


b,X,    X„      -   anYn    X,  aX  b,X„   x 

,    >         /  ,    1   1      2  1   1      1.  11      „         12      . , , 

P2tx)  =  {  J — ^ X TT  '         40 


X2Y1 


bl(X2    > 


Xlf  ,  ,blX2f  ~  aiYlf ,  "blX2fT    ai   , 

)e  +  -} 


q    (T)    =  {(. 

Yl  blX2   Yl 


blX2 


(41) 


q2(T)    =-a2rTT 


(42) 


Switching    Functions 

rVlV-VlV,  "l^        n       V2f\ 

VT)  =  ~c{( TT71 )T"      ...  f.2(1-e  } 


xiYi 


bl(X2    > 


a2Xl 


(43) 


f  f 

Xl  aiY! 

VT)=-V-H- 

Yl  X2 


blX2fl  f 

d-e  )+  a2b2Y2  T   -  bl> 


(44) 


Utilizing  Equations  (43)  and  (44),  the  time  of  the 

first  tactic  change  can  be  determined  as  the  time  at  which 

either  S,  (x)  or  S,  (X)  first  goes  to  zero.   From  this  point 

it  is  obvious  that  if  SjT)  =  0  but  S.(x)  <  0  then  the 

<P  V 

tactic  change  that  occurs  is  <f>*  =  l  to  <{>*  =  0  with  X  =  X,  ,  and 
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the  solution  is  now  in  Region  II.   If,  however,  the  final 
values  of  the  state  variables  chosen  were  such  that 
S,(T)=0,  and  S,(T)  remains  greater  than  zero,  then  the 

switch  that  occurs  is  in  X's  decision  variable,  l|/ * ,  from 

b2 

\1>*  =  1    to  \p*  =  0    or  to  ty*    =         ,  the  singular  control. 

1   2 

This  describes  three  cases  to  be  examined  based  on  the 

decision  variable,  ty*  ,     in  Region  I. 
1.   Case  I 


^*  switches  from  1  to 


a .  . Sub-case  1(a) 


Vb2 


,  the  singular  control. 


4>*  =  1  to  \p*  = 


b1  +  b2 


and  \p*    remains  the  singular 


subarc  until  T  =  T 


b.   Sub-case  I (b) 


iji*  =  l  to  ty*  = 


to  U)*  =  l    before  T  =  T, 
b,  +b„  (j) 


1   2 


c .   Sub-case  1(c) 


ty*=l    to  ty*= 


7—  to  U; *  =  0  before  T  =  X, 

b1+b2  4> 


2.  Case  II 

lp*  =  1  to  ty*  =  0    until  T  =  T, 

3.  Case  III 

i/j*  =  1  VtC[T,/0]  corresponding  to  no  switch  in  i^* 
before  (}>*  =  1  to  <J)*  =  0. 

It  is  convenient  at  this  point  to  pursue  the  develop- 
ment of  Case  I,  and  in  particular  since  the  behavior  of 
extremal  controls  is  being  examined  in  "backwards"  time 
as  a  function  of  value  of  state  variables  at  battle  termi- 
nation, to  determine  what  relationships  between  those 
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final  values  satisfy  the  previously  derived  necessary 

conditions  for  attaining  the  singular  subarc  in  T£[T,,0] 

<P 

Those  conditions  are 


Viqi    =    b2Y2*2 


a,b    Y       -    a    b,Y 
111  222 


at  T*,  where  T  *  is  the  "backwards'  time  of  entry  onto 

the  singular  subarc  where  the  singular  control  is 
b_ 


\p*  = 


b1+b2 


Forming  the  ratio  of  the  above  conditions  yields  the 
below  single  condition  necessary  for  the  original  condi- 
tions and  for  obtaining  the  singular  subarc: 


aiq2  =  a2qi 


(45) 


From  (45)  above  and  Equations  (41)  and  (42)  the  fol- 
lowing transcendental  equation  for  T.*  results. 


t  *  = 


blX2 


+  (- 


1   ,   "blX2  V 


(46) 


alYl 


b*2 


Using  the  second  of  the  conditions  given  in  (19) 


aiVl  =  a2b2Y2  3t  V 


and  Equations  (37)  and  (38)  evaluated  at  T  *  yield  the 
following  relationship  between  Y    and  Y    which  satis- 
fies the  conditions  required  to  have  a  singular  solution 
in  Region  I . 


27 


aibl  v  f   blX2  V 

ITbT  Yi     e 

2  2 


(47) 


Since  (46)  and  (47)  above  yield  the  values  of  T . *  and 

Y    from  given  final  values  of  the  other  state  variables, 

X,  ,  X_  ,  Y,  ,  it  is  convenient  to  base  further  investiga- 
1     2     1  f  f* 

1  1 

tion  on  the  ratio  — ,  with  —  being  the  particular 

Y  Y 

2  2 

value  of  that  ratio  which  insures  entry  onto  the  singular 

b„ 


subarc  where  \p*  = 


at  T  * 
b,+b„       l|> 


1   2 
The  convenience  of  using  this  ratio  lies  in  the  fact 


that  it  can  be  shown  that 


Y    f  Y    f* 

1       >       * 


f  f  * 

Y  Y 

2  2 


dS 

err  <  °    VTC[0'V 


and 


f  f  * 

*2f     *** 


dS 


^  >   o      y^Cto,!^] 


The  three  cases  presented  for  examination  can  now  be 
further  defined  thusly: 

1 .   Case  I  : 

f  * 

b_ 


f      f  * 

Y  f  "  Y  f* 
2       2 


l|>*  =  l  to  l|>' 


b1  +  b2 


with  subcases  a, 


b,c  dependent  only  on  being  the  singular  subarc. 

2 .   Case  II: 

f      f  * 

Yl     *1 

<  —  =>»  |p*r=i  to  t|/*  =  0,  the  only  tactic  change 

2      2 
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that  occurs  in  T-C"[T,,0]  since  S.(x)  is  monotone  in  that 

9  $ 

Region . 

3.       Case    III: 


f  f  * 


Y  Y 

2  1 


_  =>  ,|,*  =  i    VTCtT^f0] 


These  cases  are  developed  fully  with  respect  to  the 
behavior  of  state  and  adjoint  variables  and  switching 
times  X ,  and  T .  in  order  to  obtain  a  complete  synthesis 
of  extremal  trajectories  in  Region  I  as  a  function  of 
final  state" variable  values. 

1 .   Case  I 

f      f  * 
Y      Y  b 

11  2 

T   =  T-r    ,    <J;*  =  1  to  ip*  =  ,  the  singular 

Y„f    yJ  bl  +  b2 


control  in  Region  I. 

The  history  of  the  conflict  for  t£[0,T.*]  is  given 
by  Equations  (35)  through  (44).   The  system  of  differen- 
tial equations  given  below  describe  the  battle  history 

b„ 


for  the  period  in  "backwards"  time  where  \p*  = 


b1  +  b2 


,  9*=1 


T,*  is  treated  as  an  artificial  terminal  surface  so  that 
boundary  conditions  can  be  computed  by  evaluating  Equa- 


tions (35)  through  (44)  at  T  *. 
State  Equations 

dX 

—  -  X1(a1Y1  ♦  a2Y2) 


dX. 

dT 


=  0 


(48) 


(49) 
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dY      b  b 

±-  b  - — —   V  X 

dT     bi  +  b2   -1  2 


(50) 


2      12 

—  =  — - — —      y    x 

dT     bi+b2   2  2 


(51) 


Adjoint  Equations 
dpl 


(52) 


dp2       blb2 

—  =  "  b-Tb-2  (Yiqi  +  Y2q2) 


dT 
dq. 

dr" 

dq 


=  -a  X.p 


b  b 
1  2 


X„q. 


i   i       bi+b2   2    1 


dT 


2  blb2 

-  =  -a2XlPl  -  —^    X2q2 


(53) 


(54) 


(55) 


Switching  Functions 

dS 

TT   =   Cb2Y2^2 


(56) 


dS 

JT-    =  -XlPl(aiblYl-a2b2Y2) 


(57) 


From  Equations  (48)  through  (57)  the  following  closed 
form  solutions  were  developed. 
State  Equations 


xi(t)  =  x1(t^)«xp[-  ^-7^1y1(T^)+a2Y2f) 


(58) 


ci-/"a  (T"V))i 


X2(T)  =  X2 


(59) 
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VT)  =  W)e 


VX2  (T-T^*) 


f   VX2  (T"V> 
Y2(t)  =  Y2   e  v 


(60) 
(61) 


Adjoint  Equations 

VX      (T-T    *) 
P^T)     =  P;L(T    *)EXP[-  ^-f(a1Y1(x    *)+a2Y2f)(l-e      2  *  }]     (62) 

vx2 


aiXl 


P2(T)     =P2(V)+V{(Yl(V,(qi(V)+^7)+   Y 


*  *aV" 


f  f 

3.    X  X 

<*2«V)+  ^t"t)]  (T"V)+  — rrr 

V  VX2Y1t  V  (VX2r)^Y1I 


f  ^2    (T"Tlb*) 

(aiYlV)+a2Y2    )(1"6  )} 


(63) 


qx(T) 


"  [qi(V)+^TiTT]e  ■— TT 


VX2-Y1 


VX2Y1 


(64) 


ax  -VX       (T-T    *)       ax 

q2(T)      =  [q    <T*)+  JLf^e  *      --H-f 

V  VX      Y  VX      Y 


(65) 


where       V    = 


blb2 
b1  +  b2 


For  case  1(a),  where  ib*= —   tc:[T,,T  ,*]  the  switch- 

b1  +  b2         <=      <})       \\> 

ing    function    which    yields    T.     is 

s$(T)=s*V)+^(^(V)(qi(V)+ITT1 


1      2 


VX2   Yl 


V  VX„    Y,  * 

2      1 
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1  f     ^2  tT~VJ 

TTTi  (aiYi(V)+a2Y2  )(1"e  *    )} 


(66) 


(vx2  )  Y;L 


T.  is  given  when  S, (T)  =  0. 
<P  <P 

In  considering  subcases  1(b)  and  1(c)  it  must  be 

pointed  out  that  these  cases  are  included  to  complete 

the  trajectory  field  in  "backwards"  time.   There  are  no 

means  of  analytically  solving  for  T  ,  the  "backwards" 

e 

time  of  exit  from  the  singular  subarc  (corresponding  to 
entry  onto  the  singular  subarc  in  forward  time) ,  these 
times  are  chosen  in  order  to  provide  an  .extremal  trajec- 
tory corresponding  to  all  initial  states  at  t=0. 

*  b2 
Under  subcase  1(b),  ^*  =  1  to  ij;*=        to  <^*=1, 

1   2 


4»*=1 

Ip*      : 

b2                  1 

l^*  =  l 

b1+bp 

*' 


♦ 


T  =  0 


FIGURE  2 


the  time  history  of  the  battle  for  T(~[0,T,*]  is  again 
given  by  Equations  (35)  through  (44).   The  behavior  for 


32 


t€It.*,T  ]  is  given  by  Equations  (58)  through  (66). 

The  system  of  differential  equations  applying  for 

T£:[T  ,  T,]  are  Equations  (25)  through  (34),  but  with 
^-   e    (p 

initial  conditions  computed  at  the  artificial  terminal 
surface  at  T   by  evaluating  Equations  (58)  through  (66) 

at  T  . 

e 

The  behavior  of  system  variables  and  switching  func- 
tions for  T£"[x  ,T,]  are  given  below. 
e   <J> 

State  Equations 


a  Y  (T  )     b  X   (T-r  ) 
Xn (T)  =  X, (T  )  EXP[-   1  X.  6   (1-e  X   Z  e  )  + 

1      x  e       b  X  f 

12 


(67) 


a2Y2(Te)(T-Te)] 


X2(T)  =  X2 

Yn  (T)  =  Y.  (T  )e 

1  1   e 

Y_  (T)  =  Y_  (T  ) 

2  2   e 


b  X_   (T-T  ) 
12      e 


(68) 
(69) 
(70) 


Adjoint  Equations 


a  Y    (x    )  b  X      (T-T    ) 

P,  (T)    =  p.  (T    )    EXP[  e    (1-e   X   Z  e    )    - 

1  x     e  b  X  f 

^1X2 


a_Y„(T    ) (T-T    )] 
2   2      e  e 


(71) 


P2(T) 


Vl 


=P2(Te)-b1Y1(Te){[q1(Te)    +  f] 


blX2    Yl 

,      ,    Vif         bAf(T-T«)1 

(T-Te)+,— TTTe  } 

(b  x    )  v 


(72) 
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(   ,         r      ,      ,      Vlf        ■      -V2f(T-Te)  aiXlf 

qi(T)    =    [qi(Te)+  ;    __  f]    e  -       ^         f 


(73) 


blX2   Yl 


blX2   Yl 


q2(T)    =     [q2(Te)  + 


a2Xl 


blX2fYlf 


]    e 


-blX2f(T-Te}         a2Xlf 


blX2fYlf 


(74) 


The    switching    function    for    <j>*    which    yields    T,     for 
S.(T)     =    0    is 


9 


aiXl 


"  VV    +  blCYl(Te)    {(*1<V  +  T^ 


blX2fYlf 


(T-T    )+ 
e 


aiXl 


(blX2f)V 


b   X       (T-T    ) 

(1-  e     12  e  )} 


(75) 


Subcase    1(c):       \p*  =  l    to    ty*=  to    ip*  =  0 

1       2 


ty*  =  0 

\l>*      : 

b2 

ty*  =  l 

b1+b2 

1 

1 

1 
1 

r 


T  =  0 


FIGURE     3 
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Again  the  time  history  of  the  battle  for  t£[0,t  *] 
and  T£(T.*,T  ]  are  given  by  Equations  (35)  through  (44) 
and  (58)  through  (66)  respectively. 

The  solutions  to  the  set  of  differential  equations 

describing  the  conflict  for  tC(t  ,t.]  with  extremal  con- 

e      <J> 

trols    \p*  =  0    and    <J>*  =  1    are    given    below. 
State    Equations 


a2Y2(V      b2X2    (T-Te} 
X.  (T)    =   X.  (T    )    EXP[a.Y.  (T    )  (T-T    )+  -         e  ]       (76) 

1  le  lie  e         .         f 

D2X2 


X2(T)    =  X2 


(77) 


Y    (T)    =   Yn  (T    ) 
1  1     e 


Y_(T)    =  Y.(T   )    e 
2  2      e 


b2X2    <T"Te> 


(78) 
(79) 


Adjoint    Equations 


Pj_(T) 


a2Y2(Te)    V2    {T-Te] 

p.  (T   )    EXP[-a  Y    (T    )  (T-T    )+  ^-r-  e  e   ]      (80) 

le  lie  e  h  v 

2    2 


P2(T) 


b2X2   Yl 


32X1  „  V2    (T-Te> 

+  TY-I     (1  -  e  )] 

(b2x2  )  , 


(81) 


qx(T) 


aixi 


(82) 


q2(T) 


„       ,      ,         a2Xlf      ,       -b2X2f(T"Te)         a2Xlf      . 

[(c32(Te)+  T-f)    e  -• FT1  (83) 


b2X2  Yl 


b2X2   Yl 
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The  switching  function  for  <b* ,    S,(T)  which  yields  T, 

when  S,(T)  =  0  is 
9 


SA<T>    =    SA<T    >  +    Cb   Y_(T    )[(q,(T    )+ 
<p  <pe  2   2      e  2      e 


a2Xl 


b  x^fYnf 
2  2   1 


(T-T  )+ 
e 


32X1 


f  2   f 
(b2X2  )  JX 


b  X   (T-T  ) 
(1  -  e         e  )] 


(84) 


2 .   Case  II; 

f      f  * 
Y,      Y 


dS 


^-  <   1    =>  ip*  =  l  to  ip*  =  0  and  — ^  >  0   VxCtT  ,0] 


dT 


\l)*  =  l 

\l>*  =  0                                     I 

■* 


T  =  0 


FIGURE  4 

The  behavior  of  the  conflict  for  TGtT.,0]  is  given  by 
Equations  (35)  through  (44).   For  TCtT,,T,),  where  T,  is 
the  time  of  tactic  change  for  X  other  than  a  change  to  the 
singular  solution,  the  system  of  differential  equations 
describing  the  conflict  are  identical  to  those  which  yield 
the  solutions  given  for  Case  1(c).   For  this  case  the 
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initial  conditions  are  derived  by  computing  the  values  of 
Equations  (35)  through  (44)  at  the  artificial  terminal  sur- 
face described  by  T  .   The  solution  to  that  set  of  equa- 
tions with  initial  conditions  as  described  are 

State  Equations 

a  Y         b  X      (t-t . ) 
X1(T)    =  XX(T ,)    EXPla^d    )  (T-T    )+  -^-  e   2   2  *']  (85) 

b2X2 


X2(T)    =  X2 

Y     (T)     =    Y     (T    ) 

f         b2X2     <T"V 
Y2(T)    =  Y2r      e   Z   Z  v 


(86) 
(87) 
(88) 


Adjoint  Equations 

V2f      b2X2f(T_\) 
P]L(T)    -  P]L(T  )EXP[-(a1Y1(T1p)(T-T.)+  ^  e  v]  (89) 

b2X2 


f  a2Xl  a2Xl 

P2(T)    =P2(V"b2Y2    [%(V+  f      f)(T"V+»     ..   f,2„f] 


b2X2   Yl 


(b2x2  )  Y]_ 


b„X„     (T-T.) 
d-e22  *)] 


alXl 
qi(T)    = —    (T-y+    qi(T    ) 


(90) 
(91) 


a2Xlf  -b2X2f(T-T^)         V/ 

q,<T)    =    [<q2(T.)+  ^~)    e  *  -  ±        ]  (92) 

V        V2Y1  V2Y1 


The  switching  function  which  yields  t.  is 


s4>(t)  =  yy+  cb2Y2f[(q2(v+  a  V  f }  (T-y 


a2Xl 


f    2      f 

(b2x2  )   1 


b2X2   Yl 
(l-e^-V, 


(93) 
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3 .   Case  III : 
f      f  * 


f  * 


**-l   VTCtO,!^] 


*' 


T,  T  =  0 

FIGURE  5 

The  behavior  of  system  variables  over  time  is  given  by 
Equations  (40)  through  (44)  throughout  Region  I  with  the 


only  switch  in  tactics  being  from  <j)*  =  l  to  <})*  =  0, 


TA  for 
<P 


this  case  is  given  by  Equations  (44)  when  S,  (T)  =  0. 

C.    SYNTHESIS  OF  EXTREMAL  CONTROLS  -  REGION  II 

The  previous  discussion  has  given  a  complete  and  some- 
what comprehensive  description  of  all  possible  sequences 
of  values  of  X's  strategic  variable  meeting  the  necessary 
conditions  of  optimality  (extremal  trajectories)  when 
<J>*  =  1.   What  remains  is  to  describe  the  remainder  of  those 
trajectories  over  Region  II,  tC(t  ,  ,T]  ,  where  <J)*  =  0. 

Because  in  general,  closed  form  solutions  to  the  equa- 
tions describing  the  battle  history  over  this  region  are 
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intractable,  the  synthesis  of  extremal  trajectories  must 
be  accomplished  in  a  less  analytical  fashion.   This  will 
be  done  by  utilizing  the  experience  gained  in  the  behavior 
of  controls  over  Region  I,  and  insights  into  the  battle 
history  in  Region  II  gleaned  from  the  various  systems  of 
state  and  adjoint  equations. 

It  is  again  convenient  to  discuss  extremal  behavior 
based  on  three  cases  corresponding  to  the  value  of  ip*    at 
T,  as  given  below: 

1.  Case  I:   ll)*  =  0  at  T, 
~  ♦ 

2.  Case  II:  \b*  =  l    at  X. 

<J> 

3.  Case  III:        b2 

b1+b2     <j> 


Cases  I  and  II  can  easily  be  related  to  those  trajec- 

f      f*  f      f* 

tones  for  which   Y      Y       and    Y      Y       respec- 

<  — > 


f      f  * 
Y       Y 
2       2 


f       f  * 
2       2 


tively.   Also  included  in  these  cases  are  trajectories 
which  exited  the  singular  subarc  in  Region  I  and  which 
ended  with  the  proper  value  of  ty*    at  T, .   For  the  discus- 
sion to  follow  it  is  important  to  recognize  that  for  the 
portion  of  extremal  trajectories  which  exited  the  singular 

subarc  to  i];*  =  0  or  ip*  =  l,  comments  concerning  trajectories 

f      f*  f      f* 

beginning  at  Y      Y      or   Y      Y     ,  respectively, 

>  ■■  _ .  _  <   ' 


f      f  * 

Y^     Y^ 

2       2 


f       f  * 
Y       Y 
2       2 


are  applicable. 

The  system  of  differential  equations  describing  the 
battle  history  with  ip*  =  0,     <f>*  =  0  beginning  at  the  artificial 
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terminal  surface  described  by  T,  are  given  below  with 

<P 

initial  conditions  at  T,. 
State  Equations 
dX 

*r  =  aixiYi  (92) 


dX 

dT        2 


(93) 


dY. 
dr" 

dY. 

dr" 


=  0 


b2X2Y2 


(94) 


(95) 


Adjoint  Equations 
dp, 


dT 
dp. 


=  "alYlPl 


dT"  =  "b2Y2q2 


(96) 


(97) 


dq, 

dT"  =  "aixipi 


(98) 


dq 

dT    =  -(cp2  +  b2X2q2) 


(99) 


Switching  Functions 

dS. 

TT    =  b2CY2q2 


(100) 


dT^  =  b2CY2P2  "  aiblXlYlPl 


(101) 


f       f  * 

Y  Y 
1       1 

Recalling  that  for  values  of  —  <  —  which  corres- 


dS 


f  * 


pond    to    li) *  =  0    at    T     ,       -r~ 

<p  dx 

yielding 


*    >     0, 


VTCIT^O]   , 


alblYl    *    a2b2Y2 


(102) 
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additionally  (94)  and  (95)  above  show  that  Y   remains  con- 
stant under  \p*  =  0,    <j>*  =  0  strategies  while  Y   is  increasing, 
implying  that  (102)  will  remain  true  as  long  as  the  above 
controls  hold.   The  monotonacity  of  S,  (x)  yields, 


VT)     =    a2XlPl    "    CP2    i    °      VTCtT^T] 


or 


a    X    d      <    cd 
2    1F1    -      F2 


(103) 


with  equality  holding  only  at  X  .   Equation  (101)  yields 
the  behavior  of  S,  (T)  under  strategies  ip  *  =  0 ,  <J>*  =  0  accord- 
ing to 


dS 

-df   "    b2Y2(cp2)     (aiblYl)XlPl 


* 


substituting  for  a  b  Y   from  (102  yields 


dS 


i  _ 


dx   =  b2Y2(cp2)-(alblYl)XlPl  >  W^-^lWVl 


and  substituting  for  cp   from  (103)  yields 


dS 

dT    >    b2Y2(a2XlPl)-(a2b2Y2)XlPl    "    ° 


dS 


r   — — *-  >  0  under  strateqn 


or   - — -  >    U  under  strategies  4>*  =  0,  <J)*  =  0.   Since  \p*  =  0    at  x, 
then  S, (X.)  >  0.   Then  for  Case  I  there  are  no  further 
strategy  changes  for  X  for  x  >  X, .   This  can  be  extended 
to  the  fact  that  once  iJj*  =  0  in  Region  II  it  will  remain  at 
that  value  until  x  =  T. 
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The  battle  history  of  using  strategy  ty*=l,    4>*  =  0  under 
Case  II  are  given  below: 
State  Equations 
dX, 


dT   "  aiXlYl 


dX 

IT  =  CY2 


dYl 

dT"  =  blYlX2 


dY. 
dT 


=  0 


Adjoint  Equations 

dp, 

dT"  =  _aiYlPl 


•blYiqi 


dT 

dq 

—  =  -(•1Vl+blX2q2) 


dq2 

dT"  =  _cp2 


Switching  Functions 
dS  . 

dT"  =  _cp2 

dS 

jJ  =  b2cY2P2-a1b1X1Y1P1 


(104) 


(105) 


(106) 


(107) 


(108) 


(109) 


(110) 


(111) 


(112) 


(113) 


There  are  three  possible  trajectories  in  Region  II 
under  Case  II  which  may  occur  following  strategies  which 


are  : 
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(a)  \\>*  =  1    to  ip*  =  0 

(b)  lp*=l  VtC[t,t  ) 


(c)   ip*  =  l  to  ty*  = 


bl  +  b2 


(1- 


V^2 

x2p2 


Unfortunately,  no  general  conditions  have  been  found  which 
indicate  which  of  the  first  two  occur,  nor  has  it  been 
determined  if  the  third  switch  is  actually  possible.   For 
any  given  set  of  parameters  numerical  techniques  can  be 
employed  on  Equations  (104)  through  (113)  using  the  digital 
computer  to  determine  which  of  the  first  or  second  possible 
trajectories  actually  occur.   It  would,  however,  be  vir- 
tually impossible  to  determine  if  the  third  possibility 
occurred  due  to  numerical  accuracy  required  to  monitor 

whether  or  not  necessary  conditions  are  met  and  maintained. 

b. 


Case  III ,  . .     2 


b1  +  b2 
trajectories  to  consider. 


at  T,,  again  offers  three  possible 


(a)  i}>*    = 


b1  +  b2 


to  \l>*  =  0 


(b)   \l>*    = 


-  \  to  0>*=1 

b1  +  b2 


(c)   ifj' 


r 


b1+b2 


to  the  singular  control  in  Region  II, 


b  Y  q 

2    (l  -  -£2, 

b1+b2      x2p2> 
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It  can  be  shown  that  the  first  and  second  "backwards" 
time  derivatives  of  S. (t) ,  X's  switching  function,  can  be 
written 


dS  (X)  X 

-tt—  =  b2Y2  %(T)+  -f(aiblYl  "  a2b2Y2> 

1 


(114) 


d    S.,.  (T) 


dx 


dS 
=    ^*blX2    dx^    +(b2Y2     t-**S*(T) 


+    b2<32Y2    +    P2X2  ^*bi-  (l-**)b2]  >  (115) 


dS  . 
m 

Investigating  - — — (X.)  it  is  found,  since  S,(x.)  =  0 
dx    (J)  <$>       <J) 

and  a  b  Y   =  a  b  Y   at  X,,  assuming  continuity  of  the  dual 
variables,  that  dS ,  This  further  implies 


2     + 

d  S  (x   ) 

'  2  =  Cb2Y2  {¥2V¥2[**bl-(1-*^2)J 

dx 


(116) 


which,  beca 


use  of  the  fact  that  -rr^(X,  )  =  0  and  S.  (X,  )=0, 


dS 

.  -(X ,+)  =  0  and  £ . 
dx    <j)  4»   <j) 

controls  by  its  sign  which  of  the  three  possible  extremals 


is  optimal 


Observing  that  if  ^*(x)=0  for  TC(x,,x,+6)  where  6  >  0, 


then 


d2s 


dx 


\b         +  2  q2Y2 

f(X.   )=  -c(b_)  p_X-Y.(l  -  ~^-)     <     0 

2   (f)  2    2  2  2        2P2 


so  that  3  6  >  0«>  •  S.(X)  <  0    vxC(x.,x.+6) 
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If    ^*<T)=1    for    TC(T.  ,T,+6)  ,     then 


— /(T.    )=  cb    (b  +b„)p_X9Y      {l-(— |— )(1-  zrrr)} 
dT2        (j.  2      12      2   2   2  b1+b2  X2p2 


but,  ^*  (T )  =1  =>  S.(T)>_  0.   Also 


b  q  Y 

2  2  2 


bl  +  b2 


X-,P^ 
2^2 


d2s 


or   biP2X2  >  ~b2q2Y2   imPlies  that 


\1>         + 

-(T,      )      >     0     => 


dT 


2     ^<}> 


36   >   o    •  »  •    s    (x)    >    o       vtq(t    ,t.+S)  . 
Also    ^>*  =  1    for    TG(T.,T.+6)     =>    S.  (T)     >_   0 


for      tG(t<J),t4)  +  6) 


d%(V}    >   Q 

dT2 


blP2(VVV    -    "    b2q2(VW- 


It  is  also  clear  that  in  addition  to  the  necessary  con- 
ditions for  attaining  the  singular  subarc  in  Region  II  that 

b  q  Y 

2  2  2 

]h*     =   ( - )  (1  -        )   <  1 

■       bl+b2        X2P2 


For       tG(T,,t,+6),    which    implies 
<J>       <J> 


blP2(T0,)X2(T^     >    "    b2q2(T(|»)Y2(T<j,) 


It  is  true  then  that  for  T  =  T,  and  b,p_ (T , ) X_ (T , )  > 

<p  1    2       9       2       (J)      — 

b^^U  (^a ) Y„  (T ,  )     it    is    possible  to    have 
2    2       <J>       2       <p 
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d2s 


0   if 


X  T 


dT 


2  (T*  >  >     ° 


lp*  = 


(_!|_)(1.!2!i)if£!t(T/).0 

b,+b„       X_p_      ,2  <p 


1   2 


2^2     dT 


1   if 


d2SiJ 
dT2    ♦ 


(117) 


If   blP2(VX2(V  *  -b2q2(T(fr)Y2(T<(.)  lfc  iS  °nlY 
possible  to  have  i/j *  =  0  for  t£(t,,t,+6). 

As  in  Case  II  general  conditions  have  not  been  dis- 
covered indicating  which  strategy  is  followed  for  all 
cases  but,  it  is  apparent  that  since  the  synthesis  is  pro- 
ceeding in  "backwards"  time,  there  exists  some  final  state 
at  T=0  for  which  each  of  the  possible  strategies  are  used 
at  T  =  T,.   This  must  be  the  case  in  order  to  map  an  extremal 
trajectory  to  every  initial  state  at  T=T. 

The  battle  history  for  (a)  and  (b)  above  are  given  by 
Equations  (92)  through  (101)  or  (104)  through  (113)  respec- 
tively.  If  the  singular  trajectory  is  followed  the  equa- 
tions below  describe  battle  history. 

State  Equations 

dX, 


a1X1p1 


dT 
dX. 


dT"  =  CY2 


(118) 


(119) 


dYl 

dT"  =  **VlX2 


(120) 


dY2 

—  =  (H')b2x2Y2 


(121) 
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Adjoint  Variables 

dpl 

dFT   =    "aiYlPl 


(122) 


d£>2 

3^-  =   -(♦*b1*1q1+(l-*Mb2Y2q2> 


(123) 


dqi 

dT"    =    ■,'lW**V2«l) 


(124) 


dq 

dFT  =  -<cp2+(i-**)b2x2q2) 


(125) 


Switching  Function 

dS  . 

-^  =    cCt^T   q1+(l-f)b2*2q    ) 


(126) 


dS 

hi 

b    cY    p    -a    b    X    Y    p 
dx  2       2F2       11    1    ri 


s  _ 


(127) 


Where 


b  q    Y 

2  2    2 

li>*    =     ( )  (1    -  ) 

*  bl  +  b2  X2P2 
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V.   SOME  NUMERICAL  EXAMPLES 

Using  the  IBM  System  360  Computer,  and  by  following 
the  general  procedure  for  synthesis  of  extremal  controls 
as  outlined  in  Chapter  IV,  that  is,  choosing  a  final  state 
at  T=0  and  integrating  the  state  and  adjoint  equations  in 
backwards  time,  numerical  solutions  to  this  differential 
game  for  several  parameter  sets  were  obtained.   Each  solu- 
tion is  given  in  the  form  of  a  trajectory  field  (a  field 
of  trajectories  leading  to  different  final  states).   Be- 
cause the  state  space  of  the  differential  game  is  actually 
five  dimensional,  (four  state  variables  and  time),  and  be- 
cause it  has  been  convenient  to  base  all  investigation  on 

Ylf 
the  ratio  —  ,  the  trajectory  fields  are  displayed  on 

Y2 

what  is  effectively  a  contour  of  this  five-dimensional 

Y1(T) 
space,  by  plotting  the  ratio  versus  time.   This  pro- 

Y2(T) 
cedure  yields  a  clear  picture  of  the  behavior  of  ty* ,  X's 

strategy  variable,  as  a  function  of  time.   The  field  of 

trajectories  is  generated  by  varying  only  Y 

Integration  of  the  state  and  adjoint  equations  in 

backwards  time  was  accomplished  using  a  fourth  order  Runge 

Kutta  numerical  integration  technique.   Times  at  which 

strategy  changes  occur  for  X  and  Y  were  computed  using  a 

Newton-Rhapson  scheme  when  closed  form  solutions  for  the 

switching  functions  existed.   Where  this  was  not  possible 
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strategy  changes  were  determined  to  occur  with  sign 
changes  in  the  appropriate  switching  functions.   Addition- 
ally throughout  Region  I,  where  <j>*  =  l,  actual  values  of 
system  variables  were  determined  from  closed  form  solu- 
tions at  the  above  switching  times.   The  Runge  Kutta  tech- 
nique employed  was  verified  against  one  of  those  closed 
form  solutions  and  found  to  produce  an  error  no  greater 
than  10~  . 

Two  examples  of  the  results  obtained  are  presented 
here  in  Figures  6  and  7.   The  model  parameters  are  given 
below  the  figures. 

Figure  6  clearly  shows  the  time  history  of  X*s  strat- 
egy for  achieving  different  final  states.   Also  clearly 
shown  are  the  singular  subarcs  (the  dark  heavy  lines) 
which  correspond  to  X  splitting  his  supporting  fires  be- 
tween Y   and  Y   (these  are  called  universal  surfaces  in 
the  terminology  of  Isaacs  [4].   These  universal  surfaces 
divide  the  state  space  of  the  game  into  regions  where 
X's  optimal  strategy  is  to  concentrate  his  fire  on  either 
Y's  supporting  elements,  ty*=0     (below  the  surface),  or  on 
his  primary  force,  t|>*  =  l  (above  the  surface)  . 

Figure  7  results  from  a  slight  modification  to  the 
parameter  set  which  yields  Figure  6.   In  this  case  a  dif- 
ferent value  of  Y    is  chosen  and  again  Y    is  varied. 
For  this  particular  set  of  parameters  the  extremal  field 
is  identical  to  Figure  6  throughout  the  region  where  <J>*  =  1; 
however,  there  is  a  void  in  the  solution  space  where  <}>*  =  0, 
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Backwards  Tine  X  10 


T=0 


FIGURE  6 


xt=  4.0 
x*=  8.0 
Jf  7.0 
y^=  8.964144 


a,=0.003 
a2=0.006 
b,=0.004 
b2=0.005 


c  =0.01 
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Backwards  Time  X  10 


T=0 


FIGURE  7 


xj=  4.0 
x*=  8.0 
yj=10. 66666 
y^ll. 5967997 


a,=0.003 
a==0.006 
b^O.004 
b2=0.005 


c  =0.01 
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and  the  singular  subarc  appears  in  Figure  6.   This  void 
occurs  because  at  T,,  where  <(>*  switches  from  <}>*  =  1  to 
(j>*  =  0  and  \p*    must  also  change  from 


\\>*    = 


Vb2 


to  ifl' 


b1  +  b2 


(1  - 


V2 

p2x2 


it  is  found  that  the  second  of  the  singular  controls 
violates  the  inequality  constraint  on  ip* ,  that  is,  i|>*  >  1. 
For  the  particular  case  shown  in  Figure  7  \p*    =  1.0543061. 

Extreme  care  was  taken  to  insure  that  the  violation 
of  the  constraint  on  ^*  is  not  a  function-  of  numerical 
accuracy  in  generating  solutions,  and  it  appears  at  this 

writing  that  the  dual  variables,  P.  and  q.,  may  be  discon- 

b2 

tinuous  at  T,  when  U)*(T.)  =  : : —  .   The  possibility  that 

<j>  <f>     bi  +  b2 

this  discontinuity  occurs  is  due  to  the  fact  that  extremal 
strategies  for  both  X  and  Y  must  change  simultaneously  at 
the  above  point.   The  existence  of  such  discontinuity  con- 
stitutes a  violation  of  an  underlying  assumption  in  the 
theory  utilized  in  the  solution  of  this  differential  game. 
The  investigation  into  that  contingency  is,  however, 
beyond  the  scope  of  this  work. 

The  program  which  generates  the  solutions  presented 
here  is  available  from  Professor  J.  G.  Taylor,  Department 
of  Operations  Research,  U.  S.  Naval  Postgraduate  School. 
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VI.   MILITARY  SIGNIFICANCE  OF  THE  MAX-MIN  PRINCIPLE 

By  examination  of  the  switching  functions,  S,(t)  and 
S.(t),  and  their  derivatives,  interpretations  of  the  con- 
ditions for  when  strategy  changes  occur,  and  for  which 
strategies  are  chosen  can  be  derived.   The  interpretation 
of  these  conditions  is  similar  to  marginal  value  interpre- 
tation familiar  to  economists. 

It  has  been  previously  shown  that  a  change  in  the  Y 
force's  strategy  occurs  when  S,  (t)=0.   This  implies  that 


(a2X1)p1  =  cp2 


From  the  Lanchester  "linear  law"  attrition  of  X's  primary 
force,  X  ,  and  from  the  "square  law"  attrition  of  X's  sup- 
porting force,  X  ,  by  Y's  supporting  force,  Y  ,  the  term 
"a  X  "  and  the  coefficient  "c"  have  interpretations  "rate 
of  destroying  X   by  an  element  of  Y  ",  and  "rate  of  des- 
troying X   per  unit  Y  ",  respectively.   Additionally,  P. 
can  be  interpreted  as  being  the  marginal  value  of  each 

surviving  unit  of  X. .   From  this  it  is  easily  seen  that  Y 

1 

changes  his  supporting  weapon  allocation  only  when  Y's 
rate  of  destroying  the  value  of  X  is  the  same  by  firing  at 
either  X's  primary  or  supporting  weapons.   Y  fires  counter- 
battery,  <}>*  =  0,  only  so  long  as  (a  X  )p  <  cp  ,  or  as  long 
as  the  rate  of  destroying  X's  value  is  greater  by  firing 
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at  his  supporting  force  than  by  firing  at  his  primary 
force.   Conversely  Y  fires  at  X's  primary  force,  <J>*  =  1, 
only  when  he  receives  the  highest  rate  of  destroying  X's 
value  with  that  strategy. 

A  change  in  X's  strategy  occurs  only  when  S. (t)=0, 
or  when 


(b1Y1)qi  =   (b2Y2)q2 

where  "b  Y  "  is  the  rate  of  destroying  Y..  by  a  unit  of  X  , 

and  "b_Y  "  is  the  rate  at  which  one  X_  attrites  Y^.   q.  is 
2  2  2  2     l 

the  marginal  value  to  the  battle  of  a  single  Y.  survivor. 
Again,  X  changes  strategy  only  when  he  receives  the  same 
rate  of  destroying  Y's  value  by  firing  at  either  Y's  sup- 
porting force  or  his  primary  force.   The  strategy  X  chooses 

dS  , 
when  this  condition  is  met  depends  upon  the  sign  of       . 

This  derivative  has  a  different  form  under  each  of  Y's 
strategies.   For  <j)*  =  l 


dS. 
1  = 


(a.b.Y.  -  aob_Y0)X.p. 


dt      '  1  11     2  2  2'  1^1 

and  it  has  been  shown  that  X  splits  his  fire  according  to 

b2 

\b*    = r~  if  bn(a,Yn)  =  b„(a_Y_).   This  condition  says 

b,+b„       1    11       2    12. 
1   2 

that  X  splits  his  fires  only  if  he  has  equal  ability  to 
destroy  each  of  the  Y  elements'  kill  capability  against 
his  primary  force.  X  allocates  his  fires  in  such  a  way  as 
to  maintain  this  condition  by  allocating  his  fires  in 
amounts  equal  to  his  relative  effectiveness  against  each 
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of  Y's  force  types.   If  he  does  not  have  equal  ability  to 
destroy  the  kill  capability  of  each  of  Y's  force  types 
against  his  infantry,  he  chooses  his  strategy  to  achieve 
that  ability.   That  is,  if  b  (a  Y  )  <  b  (a  Y  ) ,  and  he  is 
less  effective  in  destroying  Y  's  capability  to  destroy  his 
primary  force  than  in  destroying  Y's  ability  to  destroy 
that  force,  he  concentrates  his  fire  on  Y.  ,  i|j*  =  1,  in  an 
attempt  to  achieve  this  parity.   The  same  rational  applies 
in  choosing  to  concentrate  on  Y  ,  i^« *  =  0 . 
For  <j)*  =  0,.Y  firing  counter-battery, 


dS 


dt 


*  _ 


b1(a1X1Y1)p1-b2(cY2)p2 


For  this  case  it  has  been  shown  that  if 


b1(a1X1Y1)p1  =  b2(cY2)p2 


then  X  splits  his  fires  subject  to  i|r 


2         ^2  2 

(1  -  v~r) 

P2X2 


b  +b 
1   2 


The  interpretation  of  this  condition  is  that  X  splits  his 
fire  in  order  to  maintain  equal  capability  of  destroying 
Y's  ability  to  reduce  the  value  of  each  of  his  force  types 
It  should  be  noted,  however,  that  for  this  split  of  fire 
he  again  allocates  in  amounts  equal  to  his  relative  effec- 
tiveness against  each  of  Y's  force  types,  but  because  Y  is 
concentrating  fire  on  X  ,  this  is  weighted  by  the  ratio  of 
total  value  of  surviving  Y   to  total  value  of  surviving  X 
This  has  the  qualitative  interpretation  of  weighting  the 
split  by  an  amount  proportional  to  how  much  X   feels  he 
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must  reduce  Y^  in  order  to  account  for  the  attrition  he 

2 

is  suffering.   This  split  becomes  — — — — —  when  (J)*  =  l  and  Y. 


1   2 


is  no  longer  firing  at  X„. 


As  for  the  case  where  <{>*  =  1,  X  again  chooses  his  strat- 
egies so  as  to  attain  this  parity  in  his  ability  to  destroy 
Y's  capability  of  reducing  his  value  through  each  of  his 
force  types. 

Figure  6  illustrates  this  choice  of  strategies  by  X 
which  force  him  to  parity  in  the  conditions  described 
above.   Once  parity  in  those  conditions  is  achieved,  X 
maintains  that  parity  by  splitting  his  fire  between  the 
two  Y  elements. 
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VII.   CONCLUSIONS 

The  solution  to  the  differential  game  presented  here 
illustrates  the  dependence  of  optimal  strategies  on  force 
levels  through  each  opponent's  switching  function.   Where 
this  dependence  is  not  explicit  in  those  switching  func- 
tions it  is  implicit  via  the  marginal  values  (i.e.,  dual 
variables)  which  may  themselves  be  functionally  dependent 
on  those  force  levels.   This  dependence  of  optimal  strat- 
egies on  force  levels  is  best  illustrated  in  the  problem 

at  hand  by  the  strategy  of  X  in  which  he  splits  his  fire 

2  2  2 

according  to  \b*    = ; — (1  -  )  while  Y  is  concentrat- 

b1+b2     p2x2 

ing  all  of  his  fire  on  X's  supporting  elements,  (J)*=0. 
This  strategy  illustrates  a  case  where  the  optimal  alloca- 
tion policy  is  not  only  dependent  on  force  levels  through 

the  switching  function,  but  is  itself  a  function  of  two 

i 

of  those  force  levels. 

This  problem  when  compared  to  that  presented  by  Kawara 
[5]  illustrates  that  the  nature  of  the  attrition  process 
in  a  differential  game  combat  model  has  significant  impact 
on  optimal  strategies.   Again  this  is  best  illustrated 
here  by  the  appearance  of  an  extremal  strategy  in  which  X 
splits  his  fire  between  the  two  Y  elements.   This  splitting 
of  fire  which  does  not  appear  in  Kawara ' s  problem  was  in- 
duced with  only  minor  modification  of  Kawara's  attrition 
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structure,  and  by  allowing  Y's  primary  force  to  attrite 
X's  primary  force.   Because  of  this  sensitivity  of  optimal 
strategies  to  changes  in  the  attrition  structure,  care 
must  be  taken  when  attempting  to  model  the  combat  decision 
making  process  in  a  differential  game  to  insure  that  in- 
sights gained  into  optimal  strategies  are  not  biased  by 
poorly  constructed  combat  dynamics. 
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